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♦ 

FIELD OF THE INVENTION 



[0002] The present invention relates to a method for obtaining assist torques 
to be applied to joints of legs through gravity compensation control in a human assist 
system. The present invention further relates to a human assist system with gravity 
compensation control. 
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BACKGOUND OF THE INVENTION 



[0003] At Honda's Wako Research Center, a mechanically powered walking 
assist prototype system was recently unveiled (Katoh and Hirata, The Concept of a 
Walking Assistance Suit, Welfare Engineering Symposium, The Japan Society of 
Mechanical Engineers, August 2001). The target application is to help the elderly and 
disabled people to either execute daily tasks they could not previously perform, or use less 
physical exertion than they currently employ for these tasks. The tasks considered 
include walking, lifting, sitting/standing, and climbing stairs. A big challenge in 
developing control algorithms for exoskelton systems is the control problem. The 
complexity of the central nervous system (CNS) control and the interface between 
voluntary control and external artificial control are challenging, unanswered questions. 

[0004] Thus, there is a great need for a human assist system and a method 
which will mitigate the interface between voluntary control and external artificial control. 

SUMMARY OF THE INVENTION 

[0005] A method for obtaining an assist torque to be applied to a human joint, 
in a human assist system in order to reduce the load on muscles, according to the present 
invention comprises the step of obtaining a moment due to gravity, acting on a joint of each 
human segment, based on equations of force and moment balance on each segment. The 
method further comprises the step of obtaining an assist torque to be applied to the joint to 
compensate for the moment due to gravity, acting on the joint. In one embodiment of the 
present invention various criteria are used such a mechanical energy, metabolic energy 
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and/or stability/equilibrium balance. In addition, the present invention can account for 
the situation when there is substantially no relative motion in a joint and thus, the 
mechanical energy component of gravity compensation is approximately zero. 

DESCRIPTION OF THE DRAWINGS 

[0006] Figure 1 shows the region where feasible assist is given. 
[0007] Figure 2 shows isolated rigid body. 

[0008] Figure 3 is a block-diagram of the interaction of the human sensory 
motor control system and the exoskeleton actuation, sensing, and control system in order 
to control the human body equipped with an exoskeleton. 

[0009] Figure 4 is a six-segment planar biped showing the initial and final 
position of the lifting cycle of the motion. 

[0010] Figure 5 is a block-diagram of the human assist system. 

[0011] Figure 6 is a flowchart showing operations of the human assist 

system. 

[0012] Figure 7 shows a motion trajectories at the five joints for a lifting and 
lowering motion of a 10kg mass. 

[0013] Figure 8 shows simulated comparison of the magnitude of the assist 
torque, muscle torque, and net joint torque at the knee. 

[0014] Figure 9 shows simulated comparison of the magnitude of the assist 
torque, muscle torque, and net joint torque at the hip. 

[0015] Figure 10 shows simulated comparison of the assist torque, muscle 
torque, and net joint torque at the knee. 
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[0016] Figure 1 1 shows simulated comparison of the assist torque, muscle 
torque, and net joint torque at the hip. 

[0017] Figure 1 2 shows quantities for estimating joint power at the knee, 
including the joint torque (top), and joint angular velocity (middle). 

[0018] Figure 1 3 shows quantities for estimating joint power at the hip, 
including the joint torque (top), and joint angular velocity (middle). 

[0019] Figure 14 shows feasibility region of assist torque vs. net joint torque 
at the knee joint. 

[0020] Figure 15 shows feasibility region of assist torque vs. net joint torque 
at the hip joint. 

[0021] Figure 16 is a flowchart illustrating a technique for determining and 
applying torques based upon multiple factors according to one embodiment of the present 
invention. 

DETAILED DESCRIPTION OF THE PREFFERRED EMBODIMENTS 

[0022] Human exoskeletons are structures of rigid links mounted on the body 
that promise to enable normal humans to perform their daily activities with less effort. A 
major limitation of the practical use of exoskeletons for daily activities relate to the control 
problem. The complexity of the central nervous system (CNS) control and the interface 
between voluntary control and external artificial control are challenging, unanswered 
questions. In this specification, we present a novel method for partitioning the 
mechanism between voluntary control and artificial control by the concept of relegation of 
control. In particular, the control of humans equipped with an augmentation device 
(human assist system) is relegated to two subsystems: motion generation and gravity 
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compensation. The motion generation subsystem represents execution of voluntary 
motion from commands generated from the central nervous system. This subsystem 
describes the kinetic energy of the motion. The gravity compensation subsystem is 
responsible for artificial control of the actuators attached to the body. The gravity 
compensation control accounts for the potential energy of the system and is responsible for 
compensating for the torques due to gravitational acceleration. This partitioning of the 
control to the corresponding kinetic and potential energy is hypothesized to mitigate the 
amount of interference between voluntary control and artificial control. 

[0023] Gravity Compensation Concept 

[0024] Skeletal muscles which produce the muscle torque are also called 
"voluntary muscles" because they are responsible for purposeful movement of the body. 
These muscles are voluntary as the person can control their motion with his/her will. A 
challenging problem in the design of exoskeleton controls is to develop controllers which 
minimize the interference between the assist control and the voluntary motion executed by 
the neuromuscular system. In order to design an effective controller, consider the 
mathematical representation of the dynamics of a musculoskeletal system actuated by 
voluntary control from the muscles and artificial control from the augmentation device. 
The dynamics can be modeled by the following set of differential equations, 

M (q)q + H(q,q)q + G(q)= r m + r a (1) 

where T m and z a are the torques developed from the voluntary control of muscle 

actuators and artificial control of assist actuators, respectively. The vector q represents 
the generalized coordinates, Mis the inertia matrix, H describes the effects of the coriolis 
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and centrifugal torques, and G is the vector of gravitational forces. Equation 1 
describes the dynamics of an unconstrained system. If the motion of the human 
involves external contact, or closed loops (such as both feet on the ground), the dynamics 
must be modified, 

M{q)q + H(q, q)q + G(q) = T m + z a + J T T (2) 

where, f is the Jacobian transpose matrix, and T 1 represents the contact force. 

The sum of the voluntary muscle torque Z m and exoskeleton assist torque z a 
represents the net joint torque, T n acting at the joint 

T n =T m +T a (3) 

The computation of the actuator controls from the system of equations in 1 is inherently 
ill-posed, i.e. different combinations of muscle torques and assist torques can produce the 
same motion (or same net joint torque). One method to resolve the redundancy is by a 
concept called relegation of control. A relegated control strategy can be used to assign (or 
relegate) the motion generation component of the dynamics to voluntary motion, actuated 
by the muscles, and to assign the static equilibrium component to the exoskeleton 
actuators. 

[0025] This subdivision is equivalent to partitioning the equations of motion 
into the kinetic energy component and the potential energy component, respectively. 
Since the rate of change of the potential energy of the system is simply the torque due to 
gravity, the exoskeleton actuators must generate a torque %g to compensate for forces due 

to gravitational acceleration. The mathematical representation of this partitioning for the 
unconstrained system is given by, 
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(4) 



x m "= M{q)q + H{q,q)q 



(5) 



Therefore, the control law for the assist torque v a is simply a controller which negates 
the effects due to gravity. Hence, we refer to the control law of equation 4 as gravity 
compensation controller. 



noted below. 

1) There is a natural subdivision between the voluntary actuators which are 
responsible for forward progression of motion and the assist actuators which are 
responsible for preserving static equilibrium. This subdivision may mitigate the 
interference between voluntary control and artificial control. 

2) Since gravity torques are a function of joint positions and orientations and do 
not contain velocity and acceleration terms, a gravity compensation strategy is not 
sensitive to noise amplification from numerical differentiation of kinematic variables. 

3) Although gravity compensation can be viewed as a model based control 
strategy, it has limited sensitivity to parametric uncertainties as compared to inverse 
dynamics methods which require very precise dynamic models. 

[0027] . One limitation of a pure gravity compensation control algorithm is 
that it may degrade efficiency for certain tasks whereby gravity effects actually help the 
forward progression of motion. For example, human gait is believed to be a highly 
efficient motion due to the passive transfer of potential to kinetic energy from the 
gravitational forces. A method is required to determine when gravity compensation will 



[0026] 



The gravity compensation control has several compelling features as 
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help motion and when it will interface with the natural dynamics of the system. 
Subsequently, a more intelligent control can be developed to account for the deficiency of 
gravity compensation for certain tasks and at a particular point. 

[0028] In the following section, we provide the basis for instances when 
gravity compensation is mechanically efficient, i.e. preserves the natural dynamics of the 
overall system. 

[0029] The basis for an intelligent assist control 

[0030] The coordinated and intelligent action of the assist torque not only 
provides opportunity to reduce fatigue and risk of injury, but also enables control of joint 
impedance to stabilize motion. Although it is difficult to quantify the degree to which an 
assist torque can stabilize motion, the effects of additional actuation on the energetics of 
motion may be more readily incorporated in the design of an assist control. The 
mechanical energies are excellent means of quantifying and describing the efficiencies 
associated with an assist control algorithm. At the joint level, the biomechanical 
quantities used to describe the power generated by the muscles is the product of net 

voluntary muscular moment, T m and joint angular velocity, Q. 

Pm = *n& (6) 
Similarly the net joint power is given by 

p n =z n a (?) 

Evaluation of power output at the joint level overlooks the presence of co-activation 
which has been experimentally confirmed in stabilizing the musculoskeletal system by 
enhancing the joint impedance. In other words, the power equations described in 
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Equation 6 and 7 cannot account for simultaneous generation of power by one muscle 
group and absorption by the antagonist group, or vice versa. 

[0031] However, if the power contribution of individual muscles is 
considered, a more precise consideration of energy flow in the system can be obtained 
which may point to more appropriate algorithms for assist control. If the muscle force and 
the rate of change of muscle length are known, the power contribution of an individual 
muscle (Pm) can be determined from 

Pm = F m L (8) 

where F m and L represent muscle force and muscle velocity, respectively. It should 
be noted that the muscle power at the joint level, using Equation 6, is not equivalent to • 
the sum of the power contribution of muscles that span it. Power is the rate of doing 
work. In order to calculate work done, we must integrate power over a period of time. 

The work done by the voluntary muscular action during a period t\ to t 2 is 

W m = I '^P.Jt (,) 

Similarly, the net mechanical work from the muscles and the assist actuators is given by, 

w n = y^p n dt (10) 

[0032] The power Pm and work Wm can be either positive or negative. 
Positive work is work done during a concentric contraction, when the muscle moment acts 
in the same direction as the angular velocity of the joint. Concentric contractions occur 
when the muscle contraction permits the muscle to shorten. Negative work is work done 
during an eccentric contraction, when the muscle moment acts in the opposite direction to 
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the movement of the joint. Eccentric action occurs when a muscle is activated, but is 
forced to lengthen due to the high external load. A larger muscle tension can be created 
by the same activation level during eccentric action at the muscle length and velocity than 
during the concentric action. Also, it has been shown that eccentric contraction is 
metabolically more efficient. References should be made to the following documents 
which are incorporated by reference herein in their entirety: (1) R Wells, M Morrisey, and 
R Hughson. Internal and physiological responses during concentric and eccentric cycle 
ergometry. Eur. J. Appl Physiol, 55:291-301, 1986; and (2) M. Gagnon and G. Smith. 
Muscular mechanical energy expenditure as a process for detecting potential risks in 
manual materials handling. 1 Biomech., 24(3/4): 191-203, November 1991. 

[0033] The metabolic cost (MC) of performing a task should take into 
account the efficiencies associated with positive and negative work, 

W + W 
MC = — + — (11) 
n n 

where represents concentric work (the work done when the muscles shorten) and 
^-represents eccentric work (the work done when the muscles lengthen). The 
constants n+ and n are the efficiencies associated with concentric and eccentric action, 
respectively. At the muscle level, the total metabolic cost of synergistic action of m 
muscles is obtained by integrating the instantaneous total power and considering the 
higher metabolic efficiency of eccentric action. 



MC 




The computation of mechanical work or metabolic work is unable to resolve the 
metabolic cost of isometric muscle action. In an unassisted human motion involving 
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isometric work against gravity, mechanically there is no movement; thus no mechanical 
work is done. However, metabolically there is a cost. The work requirement to hold 
body segments against gravity cannot therefore be determined with the muscle power or 
joint power computations. Such work is not negligible in many pathologies and in 
work-related lifting or carrying tasks where loads are held momentarily against gravity or 
are carried with a forward body lean for extended periods. This fact leads to an 
interesting and practical advantage of gravity compensation control. That is, gravity 
compensation intrinsically removes the metabolic costs associated with isometric 
contractions against gravity. In an alternate embodiment, described below, the 
invention accounts for various criteria to determine whether and how to apply a 
computed torque using, e.g., mechanical energy, metabolic energy and stability. 



[0034] Feasibility of assist torque 

[0035] One criterion for determining the feasibility of an assist control 
algorithm is to consider the effect of an assist control on metabolic cost. We consider the 
instantaneous assist torque to be metabolically feasible if the metabolic cost of the assisted 
control is less than the metabolic cost of unassisted control, 

LZU<LIU (13) 

where n m and I2 n represent the instantaneous metabolic efficiency, depending on if 
the instantaneous power is positive or negative. 

[0036] In order to simplify our analysis by considering only the mechanical 
cost of motion, suppose n m = n n = 1 . Then Equation 13 simplifies to, 
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I X m |<| X n I (14) 

In terms of mechanical energy, the above assumption implies that the design of assist 
control should be such that the magnitude.of the assisted muscle torques does not exceed 
the magnitude of the unassisted muscle torque. We can express the inequality 

constraint in terms of the assist torque T a as follows. From Equation 3, the following 

relation holds, 

Km H^n^al (15) 
Substituting Equation 15 into Equation 14, 

I X n "T a |<l X n | (16) 

It follows that a necessary and sufficient condition to satisfy Equation 16 is to apply an 
assist torque that satisfies the following inequality constraint. 

0 < x a < 2x n x n > 0 

2x n <x a <0 x n <0 (17) 

The feasibility region according to the criteria in Equation 17 is plotted in Figure 1. In 
order to develop an intelligent gravity assist controller, we must consider the mechanical 
energies and the associated feasibility region. For making a general control strategy, it 
is imperative to develop hybrid controller that will complement the gravity compensation 
controller presented here, leading to a control strategy that will utilize the natural 
dynamics of the system when gravity helps motion, as well as compensate for gravity 
when the gravitational forces are hindering motion. 



12 



FW Ref:8887 
1420704 



[0037] A method for obtaining an assist torque to be applied to a human joint, 
in a human assist system in order to reduce the load on muscles, according to the present 
invention comprises the step of obtaining a moment due to gravity, acting on a joint of each 
human segment, based on equations of force and moment balance on each segment. The 
method further comprises the step of obtaining an assist torque to be applied to the joint to 
compensate for the moment due to gravity, acting on the joint. In one embodiment of the 
present invention various criteria are used such a mechanical energy, metabolic energy 
and/or stability/equilibrium balance as described in greater detail below. In addition, the 
present invention can account for the situation when there is substantially no relative 
motion in a joint and thus, the mechanical energy component of gravity compensation is 
approximately zero. 

[0038] A human assist system for applying an assist torque to a human joint 
to reduce load of muscles, according to one embodiment of the present invention 
comprises a motor for applying an assist torque to a joint and a motor driver for driving 
control of the motor. The system further comprises a controller for determining a desired 
value of an assist torque, comprising a processor and a memory. The controller is 
configured to obtain a moment due to gravity, acting on a joint of each human segment, 
based on equations of force and moment balance on each segment and then to obtain an 
assist torque to be applied to the joint to compensate for the moment due to gravity, acting 
on the joint. 

[0039] Thus, according to the present invention, there is a natural subdivision 
between the voluntary actuators which are responsible for forward progression of motion 
and the assist actuators which are responsible for preserving static equilibrium. This 
subdivision may mitigate the interference between voluntary control and artificial control. 
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[0040] According to an embodiment of the present invention, a moment due 
to gravity, acting on the joint is obtained based on a ground reaction force acting on the 
foot, the center of pressure of the foot, and an inclining angle of each segment in the step of 
obtaining a moment due to gravity, acting on the joint. 

[0041] Thus, a moment due to gravity, acting on the joint can be easily 
obtained without using a complicated method. 

[0042] According to another embodiment of the present invention, terms of 
accelerations except those of the acceleration of gravity, terms of angular acceleration and 
terms of horizontal forces are set to zero in the equations of force and moment balance on 
each segment, to obtain a moment due to gravity, acting on the joint. 

[0043] Thus, a moment due to gravity, acting on the joint can be obtained 
with reliability and without measuring or calculating terms of center of mass accelerations, 
terms of angular acceleration and terms of horizontal forces. 

[0044] According to another embodiment of the present invention, the 
applied torque at any given joint is estimated by calculating the net torque due to 
gravitation acceleration. 

[0045] Thus, the applied torque at any given joint can be easily estimated. 

[0046] According to another embodiment of the present invention, a ground 
reaction force is obtained based on measurement from a sensor. Accordingly, a ground 
reaction force can be obtained with reliability. 

[0047] According to another embodiment of the present invention, a ground 
reaction force is obtained based on predetermined constants. Accordingly, a ground 
reaction force can be easily obtained without fail. 
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[0048] According to another embodiment of the present invention, the center 
of pressure under the foot is obtained based on measurements from a sensor. 
Accordingly, the center of pressure under the foot can be obtained with reliability. 

[0049] According to another embodiment of the present invention, an assist 
torque is obtained in real time through real time processing. Accordingly, the method and 
system are appropriate to real-time human assist control. 

[0050] According to another embodiment of the present invention, segments 
include, a foot, a shin and a thigh. Accordingly, an assist torque to be applied to any of an 
ankle joint, knee joint and a hip joint can be obtained. 

[0051] According to another embodiment of the present invention, an 
inclining angle of each segment is obtained based on a measurement from a sensor. 
Accordingly, an inclining angle of each segment can be obtained with reliability. 

[0052] According to another embodiment of the present invention, the sensor 
is a joint angle sensor which indicates a joint bending angle. 

[0053] According to another embodiment of the present invention, the joint 
angle sensor is a potentiometer. 

[0054] Thus, an inclining angle of each segment can be obtained with 
reliability and without a need for a sophisticated sensor. 

[0055] According to another embodiment of the present invention, the 
method is used during a period of human operations of lifting and lowering a load. 
Accordingly, the human assist control can be carried out with reliability during a period of 
human operations of lifting and lowering a load. 
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[0056] According to another embodiment of the present invention, the 
system is of exoskeleton type. Accordingly, control of the human assist system of 
exoskeleton type can be carried out with reliability. 

[0057] Iterative "Ground Up" Gravity Compensation 
[0058] Here, we present the gravity compensation algorithm in a recursive 
formulation. This formulation is more suited for realization of exoskeleton control 
schemes that are more robust to parametric uncertainties and un-modeled dynamics. The 
algorithm uses the vertical ground reaction force as a constraint, and iteratively computes 
the moments at the joints due to gravity. Consider a multi-body planar dynamical system. 

For an isolated body segment i (/ = 1 . . . n) as shown in Figure 2, let ( x j , yj ), Oj , 6j be 

respectively the accelerations of the center of mass, joint angle with respect to the vertical, 
and angular acceleration. The physical parameters, mj, Ij, lj, and kj, represent 
the mass, moment of inertia, segment length, and length to center of mass of link i. 

[0059] Let Fj, Gj, and Tj, represent respectively, the horizontal force, 
vertical force, and joint moment exerted on segment i by segment i - 1. Similarly, let 
-Fj+i, -Gj+i, and -t . represent respectively, the horizontal force, vertical force, 

and moment exerted on segment / by segment i + 1 . The following Newton-Euler 
equations are derived from analysis of the force and moment balance on each segment. 
F J+1 =F i -m i x i (18) 

G J+1 = G r wjff- mi 'yi (19) 

= *i ' F i k i cos{a 2 h G^ silked F M (7 y : k^cos^h 
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(20) 



Consider link one to be the foot and let F lf G l9 be the ground reaction force acting at 
the center of pressure. The reaction moment at center of pressure is considered to be 
zero, i.e., r = 0 . The length /, originates at the center of pressure and terminates at 

the ankle joint, and the length ki originates at the center of pressure and terminates at the 
center of mass of the foot. The coordinates of the center of mass of each segment are 
calculated using kinematic equations. Using the above Newton Euler equations, 
the "ground up" inverse dynamics procedure utilizes the kinematics as well as the ground 
reaction forces to recursively estimate the net joint force and net joint moment at 
successive joints. Equation 20 represents the net joint torque T' at joint/. In 

theory, the vector of joint torques r Vie [l...n] is identical to the net joint torque 

obtained using Equation 3. The distinction is that this procedure is iterative and 
requires the ground reaction force as a constraint. The integration of ground reaction 
forces and kinematic data in an iterative procedure is advantageous because the 
formulation does not require modeling the entire body: it is therefore the preferred 
method for estimating joint moments and joint forces at the ankle, knee, and hips. 

[0060] With the proper constraints, the "ground up" inverse dynamics 
equations may be used to develop a "ground up" gravity compensation algorithm. From 
Equations 1 8-20, it follows that the contribution of gravity and vertical static loads on the 
joint moments can be observed by setting all accelerations, and all horizontal joint reaction 
forces to zero. That is, 



17 



FW Ref.: 8887 
1420704 



X.=y.=0.= F .=O (21) 

Using the above constraints in Equations 1 8-20, we obtain the iterative formulation to 
compute the force and moment at each joint due to the effect of gravity (denoted by the 
subscript g). 

FrfHV^O _ (22) 

G g(i+V = G g(i) ' m iS 

* e a+V = +T gd) + G gd) k i sin < 0 iJ + G g(i + i/ h ■ ki)sin( e L ) (23) 

Since the above equations relate the effect of vertical static loads to the net moment, the 
constraints for the ground reaction must appropriately be selected as 

F g (V = 0 (24) 

Vi; =0 ' ( 25 ) 

n 

G g(V = y L nj i^ + G e (26) 
1=1 

n 

where G e is the net vertical static force due to external loads and X m i£ is the 

i=i 

gravitational force due to total body mass. 

[0061] Suppose joints i (i = 1 . . . n) are all actuated. The gravity 
compensation control law used to generate the desired assist control at each joint is, 

Vi; = 0 ( 27 ) 
= % 8 (i+\) ( 28 ) 
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The desired assist torque at all the joint is simply the vector generated by 

X a(desire) = fr a (l),T a (2), ,T a (n)] (29) 

If a joint is not actuated, then the assist torque at that joint is simply zero. 

[0062] Entire System 

[0063] The block-diagram of the entire system including a gravity 
compensation controller, an exoskeleton actuator system and a human and an exoskeleton 
is shown in Figure 3, The exoskeleton actuator/control system takes the desired assist 
torque that is calculated using the above controller and attempts to generate the desired 
torque at its output. The actual assist torque that is used to drive the human joints is the 
output of the actuator system. The gravity compensation controller and the exoskeleton 
actuator system constitute a human assist system. 

[0064] Human Assist System 

[0065] The block-diagram of the human assist system is shown in Figure 5. 
As mentioned above, the human assist system comprises the gravity compensation 
controller 100 and the exoskeleton actuator system 200. The gravity compensation 
controller 100 has a CPU 101, a memory 102, a D/A converter 103, an A/D converter 104 
and a digital input/output unit 105. The exoskeleton actuator system 200 has an actuator 
unit for applying a desired assist torque to each of the j oints. The j oints include both ankle 
joints, both knee joints and both hip joints. A plurality of actuator units are provided for 
these joints. Each actuator unit includes a motor driver 201 , DC servomotor 202, a gear 
203 and a potentiometer 204. 
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[0066] When a start/stop switch 2 is set to ON state (that is, a start switch is 
tuned on), the gravity compensation controller 100 starts its operation. When the 
start/stop switch 2 is set to OFF state (that is, a stop switch is tuned on), the gravity 
compensation controller 100 stops its operation. While the start/stop switch 2 is set to 
"ON" state, the gravity compensation controller 100 iteratively calculates a desired assist 
torque for each joint at certain intervals, based on Equations 22 to 29. In Equation 26, 
G g (i) may be obtained through measurement with a ground reaction force sensor 1 . The 
ground reaction force sensor 1 may be a load-cell type one set either on the bottom side of 
a foot or on the floor. Alternatively, G g (i) may be obtained using data stored in the 
memory 1 02. The center of pressure under each foot may be calculated or measured using 
in-shoe pressure sensor. The body segment parameters, such as mass of each segment, 
location of the center of mass of each segment, and lengths of each segment may be 
obtained using regression equations as reported in, Winter D.A(1990), Biomechanic and 
Motor Control of Human Movement, 2 nd Edition, Jhon Wiley & Sons, Inc. which is 
incorporated by reference herein in its entirety. 

[0067] The mass of an external load, lifted or carried, by the person may be 
known from prior measurement. The mass may be assumed to be equally shared by the 
right side segments and the left side segments. In Equation 23, a joint angle with respect 
to the vertical (joint inclining angle) &j may be obtained based on an output of the 
potentiometer 204 at each joint. The output of the potentiometer 204 represents a bending 
angle at the joint (joint bending angle). A joint angle with respect to the vertical 6j can 
be calculated from a bending angle at each joint. 

[0068] Then the gravity compensation controller 1 00 delivers a desired value 
of assist torque for each joint, to each motor driver 201 of each actuator unit through D/A 
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converter 103. In each actuator unit, the motor driver 201 drives the DC servomotor 202 
to deliver the desired assist torque to each joint. 

[0069] Operational Process 

[0070] Figure 6 is a flowchart of operational process of the human assist 

system. 

[0071] At step S605, time is set to zero when the start switch 2 is turned on. 
At step S610, the static vertical component of ground reaction force is obtained through 
measurement or estimation. 

[0072] At step 615, a joint angle with respect to the vertical 0j (orientation 
of segment i) is obtained through a sensor, which may be the potentiometer at each joint. 
At step 620, a desired assist torque at joint i to overcome gravitational forces, is calculated 
based on Equations 22 to 29. 

[0073] At step 625, it is determined whether or not calculations have been 
carried out for all segments. If the calculations have not been carried out for any of the 
segments, a counter for i is incremented by 1 at step S630 and then the process returns to 
step S61 5. Otherwise, the process proceeds with step S635. 

[0074] At step S635, a desired assist torque is delivered to each actuator unit 
through D/A converter in order to generate the desired assist torque. At step S640, the 
process waits a certain time interval. 

[0075] At step S645, it is determined whether or not the stop switch 2 is 
turned on. If the result of the determination is affirmative, the process ends. If the result 
of the determination is negative, the process returns to step S610. 
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[0076] Simulations 

[0077] The gravity compensation protocols are simulated for a 
lifting/lowering motion of a mass representing a manual material handling task. A 
six-link planar system modeling the foot, lower leg, upper leg, torso, upper arm, and lower 
arm is used to conduct the analysis, as shown in Figure 4. The effect of dynamic factors 
and external mass on the various kinetic and kinematic parameters of the lift have been 
studied extensively by biomechanists. References should be made to the following 
documents that which are incorporated by reference in their entirety. D. Gagnon and M. 
Gagnon, "The influence of dynamic factors on triaxial net muscular moments at the 15/sl 
joint during asymmetrical lifting and lowering" Journal of Biomechanics, 25:891-901, 
1992, and S. H. Hsiang and R. W. McGorry, "Three different lifting strategies for 
controlling the motion patterns of the external load" Ergonomics, 40:928-939, 1997. 

[0078] Such studies have been performed to reduce the risk factor through 
identification of ergonomic intervention. 

[0079] Figure 7 shows a motion trajectories at the five joints for a lifting and 
lowering motion of a \0kg mass. Figure 8 shows simulated comparison of the magnitude 
of the assist torque, muscle torque, and net joint torque at the knee. In the region where 
the muscle torque at the knee exceeds the net joint torque at the knee, gravity compensation 
control increases the mechanical power required by the muscles to perform the task. Our 
analysis cannot predict whether metabolic power is increased or decreased at each time 
instant. More sophisticated tools are required to fully understand the effect of gravity 
compensation on the metabolic cost. Moreover, gravity compensation may in fact 
improve stability at the expense of increased mechanical work. 
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[0080] Figure 9 shows simulated comparison of the magnitude of the assist 
torque, muscle torque, and net joint torque at the hip. Gravity compensation control 
increases the mechanical power required by the muscle to perform the task in the region 
where the muscle torque at the hip exceeds the net joint torque at the hip. Figure 1 0 shows 
simulated comparison of the assist torque, muscle torque, and net joint torque at the knee. 
Gravity compensation decreases the efficiency of motion in the region where the assist 
torque and net joint torque have opposite signs. Figure 1 1 shows simulated comparison of 
the assist torque, muscle torque, and net joint torque at the hip. Gravity compensation 
decreases the efficiency of motion in the region where the assist torque and net joint torque 
have opposite signs. Figure 12 shows quantities for estimating joint power at the knee, 
including the joint torque (top), and joint angular velocity (middle). The joint power is 
plotted in the bottom graph. The adjusted joint power considers the metabolic cost index of 
positive and negative work. Based on data available from the literature, an index of n~ = 
1.5 and n = 1.0 was used in this simulation. Figure 13 shows quantities for estimating 
joint power at the hip, including the joint torque (top), and joint angular velocity (middle). 
The joint power is plotted in the bottom graph. The adjusted joint power considers the 
metabolic cost index of positive and negative work. Based on data available from the 
literature, an index of n = 1.5 and n = 1 .0 was used in this simulation. Figure 14 shows 
feasibility region of assist torque vs. net joint torque at the knee joint. The feasibility 
region of gravity assist is denoted by the V plot ticks. The region with the 'o' plot ticks 
produce voluntary muscle torque which are not feasible. Figure 15 shows feasibility 
region of assist torque vs. net joint torque at the knee joint. The feasibility region of 
gravity assist is denoted by the blue 'x' plot ticks. The region with the 'o' plot ticks 
produce voluntary muscle torque which are not feasible. 



23 



FW Ref.: 8887 
1420704 



[0081] Figures 8 to 1 1 show that muscle torques at knee and hip joints are 
considerably reduced in comparison with net joint torques. This means that the iterative 
"ground up" gravity compensation has significantly reduced the work required by the 
muscles to perform this task. 

[0082] Figure 16 is a flowchart illustrating a technique for determining and 
applying torques based upon multiple factors according to one embodiment of the present 
invention. An algorithm for controlling a particular joint motion and determining the 
proper force to be applied and whether or not any force should be applied to a particular 
joint is set forth in Figure 16 and described herein. It will be apparent that the algorithm 
describes one embodiment of the present invention. In this embodiment, the process 
repeats for a period of time (t) by setting 1602 a time "t" equal to zero, incrementing 1642 
by a delta (dt) and repeating until t exceeds 1644 a threshold, (tc). The process begins by 
determining 1604 whether the end-effector of the branch associated with the joint is in 
contact with the environment, i.e., is it constrained. If there is no contact, i.e., not 
constrained, then the forces and moments acting on the end-effector are known to be zero 
and the process continues with step 1608. If there is contact with the environment, i.e., 
the end-effector is constrained, then the reaction forces and moments are determined 1606. 
The reaction forces and moments can be estimated analytically or obtained using sensors. 
An example of a technique for analytically estimating the reaction forces and moments is 
set forth in R. Featherstone and D. Orin, "Robot Dynamics: Equation and Algorithms" 
International Conference on Robotics and Automation, San Francisco, CA 2000 which is 
incorporated by reference herein in its entirety. 

[0083] The process continues by determining 1608 the kinematics and 
velocities describing the degrees of freedom of a particular joint of interest. These values 
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can be estimated directly or derived from sensor measurements. The gravity 
compensation control torques are calculated 1610 using the procedures described above. 

[0084] One embodiment of the present invention then determines whether 
there is any substantial movement between the segments surrounding the joint. If the 
absolute value of the relative jangular velocity between two connected body segments is 
less than a small threshold (e) 1612 then there is essentially no joint movement. If the 
relative motion spanning a joint is zero, then no mechanical work occurs. However, 
since the muscles are contracting isometrically to compensate for gravity, there is a 
metabolic cost for which the present invention accounts. The small threshold is used to 
account for measurement and model errors. If there is essentially no relative motion 
between adjacent segments, then the gravity compensation torques calculated in step 
1610 are used 1640 as the control methodology and can be applied to drive the system. 

The process continues by incrementing 1642 the time or, in alternate embodiments, 

J 

analyzing another joint. 

[0085] If the absolute value of the relative angular velocity between two 
connected body segments exceeds the threshold, then the present invention uses 1614 
multiple criteria to assess the feasibility 1622 of the control algorithm. Some examples of 
such criteria include mechanical energy/power feasibility, metabolic energy/power 
feasibility, stability/equilibrium feasibility. As described above, the mechanical 
energy/power of an assist torque is feasible 1616 if the magnitude of the assisted muscle 
torques does not exceed the magnitude of the unassisted muscle torque as represented in 
Figure 1 which shows the regions of mechanically feasible assist torques in relation to the 
net joint torque. 
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[0086] Similarly, the present invention can use metabolic energy/power 
feasibility to determine 1618 the feasibility of the control algorithm. Determining the 
metabolic energy/power feasibility is more complicated than determining the mechanical 
energy/power feasibility. For example, each muscle may have a different efficiency 
index, most often approximated by a constant number. In reality, the efficiency index 
could be a nonlinear function of muscle parameters and system state variables. In 
addition, these indices may vary between people. In one embodiment, a control torque is 
determined to be feasible if the metabolic cost of assisted joint motion does not exceed the 
metabolic cost of the unassisted joint motion. One way of determining the metabolic cost 
is set forth in above in equation 12. From this equation the feasibility region may be 
constructed. 

[0087] Another possible criteria is stability and maintaining equilibrium. 
The loss of stability causes the body to expend energy to regain balance (equilibrium 
reaction). Often times the equilibrium reaction comes at the expense of other motor skills 
including minimizing mechanical and metabolic energy. A preventative measure against 
the loss of stability is one that forces the mechanism responsible for maintaining 
equilibrium to employ the musculature to regain balance through body control. Evidence 
of stability taking precedence over energy consumption is in increased joint stabilization 
by co-contraction of antagonistic muscle pairs. Quantifying the stability can be done in a 
variety of ways such as the method of Lyapunov exponents as set forth by J. Dingwell et. al 
"Slower speeds in patients with diabetic neuropathy lead to improved local dynamic 
stability of continuous overground walking" Journal of Biomechanics, Vol 33, pp. 
1269-1277 (2000). Lyapunov exponents quantify the rate at which orbits on an attractor 
converge or diverge as the system evolves in time, and provide a direct measure of the 
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stability of those orbits. A positive value for the largest Lyapunov exponent is an 
indication of the global instability and sensitivity to initial conditions that define the 
presence of chaos. Another method to quantify dynamic stability is by computing the 
rate of change of angular momentum as described by A. Goswami and V. Kallem "Rate of 
change of angular momentum and balance maintenance of biped robots" Proceedings of 
the International Conference on Robotics and Automation (2004). The relative 
instability of the system is directly correlated to the magnitude of the rate of change in 
angular momentum. The importance of the stability/equilibrium feasibility 1 620 depends 
upon the specific subject and task and the stability feasibility 1620 determination may 
account for a such variables. For example, stability control may be more important when 
the task is carrying a heavy load as compared to walking or when the subject is elderly as 
compared to a young subject. 

[0088] The present invention combines 1622 the feasibility results from two 
or more of the various criteria. In this example, the invention combines 1622 the results 
from the mechanical energy/power feasibility determination 1616, the metabolic 
energy/power feasibility determination 1618 and the stability feasibility determination 
1620 to determine the feasibility of the control torque determined in step 1610. The 
decision process 1622 can be as simple as a weighted average of the outcome of each of the 
three decisions, or it may be a more complex reasoning process, such as Fuzzy Logic based 
decision inferencing. The decision process 1622 may vary depending upon the 
application, the human-subject and the joint being analyzed. If the outcome of the 
decision process 1622 is feasible 1624 then the control methodology can be applied 1640 
using the computed forces. Otherwise, the if re-computation is selected 1626 then the 
system re-computes 1628 the control forces (torques) using an alternative method and the 
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re-computed forces are input to step 1614 and the process continues in the manner 
described above. An example of an alternative re-computation technique is to use 
predictive control methods, whereby the current state and controls are used to estimate 
future states. Once the next states are estimated, the controls may be computed based on 
feedback using error correction feedback.. If re-computation is not selected 1626 the 
process continues by incrementing 1642 the time. 

[0089] While particular embodiments and applications of the present 
invention have been illustrated and described herein, it is to be understood that the 
invention is not limited to the precise construction and components disclosed herein and 
that various modifications, changes, and variations may be made in the arrangement, 
operation, and details of the methods and apparatuses of the present invention without 
departing from the spirit and scope of the invention as it is defined in the appended claims. 
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